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ABSTRACT Thl$ Is the first of a two-part presentation which deals with 
certain computer controlled manipulator problems. This first part discusses 
a model which Is designed to address problems of motor control, motor learning 
adaptation, and sensorimotor integration. In this section the problems are 
outlined and a solution is geven which makes use of a state space memory and 
a piece-wise linearization of the equations of motion. A forthcoming 
companion article will present the results of tests performed on an 
implementation of the model. 
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Surmary 

A model is presented which deals with certain problems of 

f 

taotior control , motor learning, and sensorimotor Integration* live uAe 
of ef'ference copy, re-^afferen.eej. and a state apace memary are key 
factors in ita operation. The following are functiona and features of 
the propoaed system: 


1) Inscriptions of desired movements are translated Into motor 
conitands which ■will produce the specified motions* The. Ini tial 
specification of the movement is free of information regarding 
the mechanics of the effector system, 

2) The system demo ns trsCAS gradual improvement in performance 
as it gains AXperienc* from self"produced movements, 

5) Hie performance of selected movements can be more rapidly 
S-mprowd through concentrated practice. 

4) Practice of one movement may improve performance of another 
thereby showing a kind of transfer of training, 

5) Adaptations to mechartleal and certain sensory changes take 
plftte without ail *Xp licit ettot correction procedure, 

b) Mechanical interactions between Joints are automatically 
compensated in production of the motor command * 

7) Ho constraints need he placed on the geometry of the limb 
or body-part undar control, 

S3 Tlia senaory information used by the raodsl may be related to 
the joints fifths liidh, to visual space, or to any other 
coordinate system. It need satisfy no linear!ty constraints, 
hut musC be capable of uniquely describing each Limb movement. 

9) The computations performed by the model are quite simple, 
and especially suited to a parallel processing device. 


In addition to a diecussion of these properties in terms of the 
model 1 ?! operation, an implementation using a computer and nnnlpulator is 


Int reduced^ 



Ill l rod Lll: t,[ nn 


The brain motor sy*tem U Characterise by properties which are 
nOE t3lh±E>lted traditional «U-*ad* machine. M&at basic of these 
properties is t*e ability to 1™, Initially the human infant exhibit, 
di*coordinated ^vemento, which have no apparent purpose and are 
aiallesaLy ^vted. ft uC a* the child develops his mounts tike on 
a difrereac character. They become directed and effective, sircotb and 
graceful, The improved dexterity is attributable in part to the 
experience the developing organism receive, from his own attempts to 


move (2,3,10,12). The adult, moreover, U able Co select particular 
movements and center his attention upon them through practice until a 
high level of performance has been reached. The human is not limited 
to making only those movements which have been the subject of previous 
practice — it is often the case that a movement which has never before 
been attempted can be executed with a fair degree of precision. 

■fet only are we able to gain motor control of our bodies as we 
grow up but we are able to maintain control. In the norma] situation 
this, means that we nlta the adjustments needed to control pyr limbs 
even though the masses and sizes of the body parte undergo lorge 
changes throughout ontogeny. In the laboratory we arc able to 
compensate for experimentally induced distortions made to our sensory 
inputs or to the environment (10,11,27), 


Other properties of the human motor system are -iffacted by the 
mechanical nature of the skeletal and muscular system*, and the laws 
of physics which they must obey (21). The forces and torques created 

hy a mascl - of l«n influence a number of joints, even when the muscle 
is of the simple, single joint variety. Each joint is Influenced by 



a, number of muscles, not only because there ate many Bustles ‘across 1 
the joint, but because reaction torques are produced when muscles 
accelerate other joints of the body, Yfct r>ur nervous control ayatem 
effectively compensate!* for theae mechanical interactions when precise 
movements are called for. 

Finally, our limbs are useful Cools only if they will do our 
bidding, but our wishes are phrased in a language which motoneurons 
and muscle do nut undcTs tend. If wc start with the simple, perb&ps 
schematic instruction, “Close your eyes and move your hood sc that the 
tip of your finger travels a path which is a straight line," we arc able 
to comply. We are able to comply even though this specification of the 
jtovemenc of the finger gives no explicit information about the requisite 
joint moyemetita or muscle forc-ea. This me ana that our motor system is 
able to convert a description of a movement given in one coordinate 
frase into a aet of commands which are suited to act in an entirely 
different frame — that of bone, joint, and muscle (1,3, IB). 

The. purpose of ctil$ paper is to present a model of a motor 
sub-system which displays each of the properties mentioned above. The 
model presented here i$ not the only model which displays these 
properties of the biological motor system, dot is it supposed that other 
models cannot be proposed which do so ( 6 , 7,23* 26,27). The present model 
docs not presume to account for all aspects of biological motor control 
nor even completely account for those properties cited above. Hot can 
any strong claim be made regarding the basis for the similarities of 
behavior displayed by the mechanism under consideration here and Che 
biological sotor system. Ho if this model cannot be shown to be a 
necessary model, nor are its powers sufficient to describe the human motor 


System, nor can Sal effective demons t rat ton of mutual causality with the 
biological motor ays ter. be made t why develop it arid why use a computer 
and manipulator to study it? 

Tire mo tot system is complicated, being comprised of numerous 
nervous and mechanical components, and perhaps numerous Logical or 
functional components. When the psychologist or physiologist studies 
this system he has two choices. He can study the system, in its entirety 
and be forced to deal with the myriad of variables and possibly changing 
strategies which characterise the behavior of most animals, or he can 
manipulate the physiological preparation in seme way which, in addition 
to producing the desired effect, introduces unknown and unpredictable side 
effects and complications + Ihe researcher working with the simulated 
mud-el does not face this dilemma. Each sub-system or sub-sub-system is 
available for scrutiny and all interaction can be studied explicitly. He 
can b* sure the strategy of operation will not change when pa tame cars 
are changed or processes are removed. The physiologist is forced Co 
work with variables of Limited value and often prohibited from dealing 
with those variables of most conceptual importance. The response of the 
individual 0*1.1 is recorded rather than that of the ensemble. The EMG 
is recorded rather than the force delivered by the muscle to the tendon. 
This is also not a problem for the modeller because every variable Is 
available for measurement and modification* 

Perhaps the nost important strong point of the Synthetic approach 
to fflOt&r research is the effect it lias on the researcher's focus of 
attention. There is no reason to let the anatomist 1 0 subdivision -of 
the nervous system be _the guiding force in our research if the structures 
ho delineates have Little correspondence with the functional divisions of 
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the tftotrjr ays Lem „ RatheT f we should organise our thoughts about 
functional unite and conceptual Issue*, and this type of thinking results 
when the problems of design are faced, ThU approach Is given further 
power when the formulations of a modal are put tn the farm oE a working 
mechanism* For only thfin can we be sure that out suppositions were 
correct and that all vagaries have been eliminated. 

lTie»e statements are not meant to be critical of the purely 
empirical approach,. The intention is to describe how in certain ways* 
the formulation and simulation of models is complementary to the approach 
normally taken by the neuroscientist* and how these formulations can 
be useful to hire. 

it goes almost without raying that the design* implcmen cation, 
and study of $uch nod els nan have direct application for those who 
wish to produce autonomous machines. 

Cons [.ral.nfa on the Ptpbl em 

An often neglected first step in the study of the motor system 
should he the selection of a class of behavior upon which attention 
may be focussed. The human body la a versatile, mechanism capable of a 
staggering variety of movement®, The nervous- system i* also extremely 
versatile and employe a number of control strategics, Sometimes a limb 
ia moved with great deliberation and precision in which there is 
simultaneous activation of agonist and antagonist muscles. Other times 
more free-flowing u. i-tons are, made in which agonist muscles accelerate 
the masses of a limb to high velocity* the limb coasts until it i a glowed 
and stopped by the force of antagonist muscles (Jfi), Contrast, for 
exampJ c, the motion oF a delicate paint stroke to that of a baseball 
pitch. Sometimes interaction with the environment ia quite predictable 




an4 virtually unnecessary while at other time* the 

mavaraent is nothing but * get of constant adjustment* to fi x Ema i 
disturbances. When walking down a flight of stairs the position c£ each 
step and moment of foot contact ia quite predictable. Conversely, 
standing still on a moving trolley cat requires major adjustment* at each 
lurch on the track. 3he air, of a ^vement may be to achieve a certain 
position, to move at a certain velocity, or to contact an object with a 
certain force. When one presses a button the position of the finger is 
important, while the velocity at which the violinist draws his bow 
influences the sounds which result. Imagine the effects of a masseur who 
cannot regulate the force of bis udnistrations . 

Tor each of these types of movement the problems of control ere 
diIterant and one reasonably bomogeneoua solution would not be expected to 
apply to every case. In order to develop a model which can help ua to 
better understand movement we should begin by acknowledging this diversity, 
and restrict Our studies to a class of movements, the me**era of which are 
produced by one, unified control scheme or strategy. Of course, our 

roadtnaas to make this choice indicates o„r belief in a certain discreteness 
c:f control, function. 

The modal discussed here was designed to process ballistic movement. 
This means that once a movement is initiated no sensory information is used 
tc alter that ■OTMneiit during it* execution. Such movement can also bn 
called opan-loop, hut it should be realized that, ultimately, the loop ia 
closed. This is so because, though the sensory information obtained 
during a movement 1* not used to alter the progress of that »venant» it 
*** be used to alter the actor -system in euch a way that Subsequent movements 
are influenced. A special case of the ballistic movement is that which Is 


composed of a number of shore f open-Loop segments executed in ^equOnOe, 
where the sensory information produced during one itgMtflt Influences the 
production of subsequent segment*. Ihl* variation is not dealt with here, 
but Is mentioned In order to suggest the ultimate usefulness 0f solutions 
to the open”loop control and Learning problems . Results of research by 
Hrnnmond (9) and lielvill-Jones {20} regarding thft Latency of effective 
compensation to disturbances; in man further substantiate this view. 

Since we are only studying open"lcop movements , one [tight expect u& 
to make the further restriction that all Interactions with, environmental 
disturbance bn quite predictable. In fact* for simplicity, all interactions 
with the environment, other thar gravity, have been eliminated from 
consideration. We are specifically interested in controlling limb 
position as a function of time In the absence of environmental influence.. 

Thu model under consideration here was not designed to account for 
all motor function. In addition to res trio ting the class of moveiaents 
under study, we have Halted the- type of processing to be described. Ibis 
means that ocher noCor processors work along with the sub-system described 
here and the learning, or execution of even a single movement relies on 
a number of processing elements. Figure 1 is an example of a familiar 
demonstrutlon. Changing tbs motor apparatus used in. the production of 
writing does not change the essential form of the characters produced, 
even though the muscular comends involved muse be very different. Unless 
the Subject learned to produce each form of output separately, (this was 
not the case in the Sample shown) we may draw two conclusions i 

1) Motor programs exist in the nervous syg tem which are expressed 
in a language which is independent of muscular and kinematic 
considerations r O^a such program can be used to produce 
ttrtoomcnts in any of a number of limbs or body parts. 
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Pig* 1 Writing with the pETi held by different parts of the body does not 
change the shapes of the letters even though different ouscle and! 
skeletal systems are used to produce each example. A) Fen held by right 
hand (dominant}. D-) Eight arm was used to produce writing. C} Fen held 
In left hand* D) Fen held in month. E) Fen. was taped to right foot. 

The subject had essentially no previous experience writing with any body 
part other than, A.* 
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2} Xechanisifts exist in the nerves system which tan translate 
general rotor programs (as described in 1) into explicit 
instructions suitable for the muscles. mechani cs ± and sensors 
o£ a particular lint . 

This type of architectural arrangement has been discussed by Arbib (1) 
and Watfcra (25) and Eht translation process has been mentioned by Marr {10,) 
and Gelfand*et il (ft). The power of such an arrango-ant is quite attractive, 
J1[?h level processors may formulate now movements or modify old ones f or 
makA combinations without having to take the mechanical properties of 
the effectors into consideration. It is supposed that these processors 
“ y -^rnbolic operations through which planning and strategy decisions 

may also he made. They specify to the translator what the output of the 
liob should be. 

The translating mechanism, on the other hand, is not organised 
around motor program, but around the Biyo-r-ecbarto-sensovy syateauieh 
which it communicates, It is free from the responsibilities of strategy 
and planning, and need not bfc capable of performing symbolic operations. 

Us only duty is to accept detailed description* of movements and translate 
them into appropriate muscular commands. But CO perform this function 
kinematic, dynamic, and muscular info modem about the limb mis t be 
available in a usable form. This information may not be present in the 
infant„ and certainly must change as the organism grows. It is therefore 
important to the effective operation of the transistor that some mechanism 
maintains an up-to-date source of mechanical Information about the limb, 

Tht translating mechanism which converts descriptions of desired 
Output into motor commands plus the support mechanism which acquires 
mechanical information and stores it in a usable form are the topics oi 
intores t in this paper and ui.ll be referred to collectively as the 


trams la to it. 



The Model 


Let us begin the presentation of the modol'e operation by 
examining the nature of the computations required by the tTans laci-on 
process. Descriptions of movements must be converted into iso cor commands. 
Hie acceleration of an abject, taken with its initial conditions, gives 
a complete description of its mnve*cnts and the force on an object is 
that which commands its every cotton. For this simple, unconstrained 
system vo can specify the desired acceleration and use Hewter^s equation* 

V - Ha, as a translator to find the necessary force. Of course* this also 

U 

applies to rotary motion, V - .1(1, where T is the torque* J is the foment of 

jn 

Inertia* and 0 is the anguLar acceleration. If only a litr* were SO simple 
as that. 


What ig the acceleration of s limb? If we take the simple case 

where the coordinate system of Interest is that of the Limb's Joints we 

11 

can describe the acceleration by a vector,, whose number of elements 
equals the number of joints, fa, <0 Is the angular position of one joint 
and each prime marker Indicates differentiation with respect to time. 

All vectors and matrices are delineated by an underscore.) Thu moment of 
inertia* however, must be expressed as a square matrix of Funk N because, 
as mentioned earlier, torques applied to one joint will cause accelerations 
about every joint in the limb (See Fig. 2). The ^1 caprlx specifies the 
relationship between the torques and the resulting decelerations at each 

Joint in this Hots, V. = k - Unfortunately, the 

Ik acceleration at joint 1 

elements of this matrix are not constants for two reasons, Firstly, the 
amount of interaction bntweon two joints is dependent on the angular 
position, of the joints of the lizfc- (also an JJ-element vector) . Far 
Some configurations of the limb the amount of interaction is large while 
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Flg. 2 The MIT-Vicarm aanipulator (see Fig. 5) was used to demonatrate the 
potential for mechanical interactions among joints of a lirfj. These graphs 
bIlow how torques; applied to OrtS joint of the manipulator can influence other 
joints. Each movement labelled as 1 was made by applying constant torque 
to each joint* Tn movement 2 the torque at joints 1 and 3 were unchanged y 
but a step of torque was applied to Joint 2 after 50D msec, (at arrow)* Note 
that the position and velocity trajectories of all three joints were 
affected, F-poaltiont Y-velocity. 










for others it is stall (Sts Mg. Is and M . Secondly. the effective 

““ ° f 1,B!rtla ° ( a 19 sot only by the rc.sec of 

the links which Sts moved, <s link is that part of a lie* between two 

joints) bat also by the distances between the usaes and the center of 
rotation (See Pig. 3 C j) . 

For the lit* having y joints, K links, a accelerations, and JI 2 
of inertia there are N torques. 1„ addition to the torques 
applied by the -sole we nest consider the acceleration of gravity nnd 
the damping force, doe to friction. The acceleration of gravity must 
he represented by a vector of dimension N because each mass in the limb 
will be accelerated Individually. These gravity factors are also not 
constant but depend on the relation positions of the masses end joints 
in the limb (See fig, le and f). Frictional torques, also representable 
by an K-dlmcnsicnai vector, arc independent of fi, but depend on the 
Voice*ty of the moving joint. Unlike the gravitational and cement of 
inertia terms, which. In principle, may be calcoalted from a blueprint 

<’f a limb, the frictional terms often bear a complen relationship to 
the velocity of a joint. 

A fW factor relent to the equation of tnotion which o ft l y 
introduces Appreciable torques at high velocities, i* the corloli 8 
term. This torque is proceed by accelerating yn object aLo ut one axis 
Wh±Ie lt is Wtat±n & about an orthogonal axia p And the direction of 
its Action i B about a third axis orthogonal to the plane Q f the other 


two. 


odHoHUHo^l 





3 A} Accelerations of joint, 1 will cause large aecele rat ions 
aiout joint 2 flue to reaction torquea, E) The tuttion torque on 
Joint 2 is smaller here than in A because of eh* position of Joint 2 
am] its link, C) The women t of inertia of joint 1 is maxi cun because 
the tenter of mass of link 2 la far from the center of rotation, I>) Here 
the moment of inertia is almos t a ertnimum, E) The effects of the 
acceleration of gravity depend on the moment ants through uhich it acts. 
Here it is maxinmn for the link. F) Hie moment arm is zero ond no 
torque is produced about joint 1 by gravity. 

































If we rewrite Newton's equation, but Include each term introduced 


above we get: 

I “ £(0 - E {9) - C(0,0) = J(tf) ■ i (eq, 1> 

■where: T U the muscle torque vector 

G is the gravitational torque vector 
B is the frictional torque vector 
C Is the COtiolis torque vector 
jJ Is the moment of inertia matrix 

F M 

#, and are the position, velocity, and acceleration vectors r 

This equation may still look manageable, but the dependencies on 
and 0 are only implicit. Kahn (15) has worked out the explicit 
relationship using a computer programs which performs algebraic manipulations 
and. his results for it general limb having three links and three joints 
(N “ 3) but no friction Is reproduced in part in appendix A- These results 
are almost intractable, (the equations Involve about 1600 terras and 13,000 
multiplications) and virtually useless for a theory of motor function. 

But before we totally discard these results* let us examine a Special 
set of circumstances under which stsplifications can be made. If we look 
at the behavior of the limb during a very short interval of time we observe 
that eq. 1 &ti11 describes the behavior of the limb, as It must, but each 
term ten be simplified. During a short interval, call it a time slice], or 
just a slice, we see that each joint haa position and velocity, but during 
the slice their values change by only entail amounts. We may neglect flies a 
small changes qt reduce the duration of the slice to the point where the 
changes in velocity and position may be neglected. Once this is dene each 
element of a vector or matrix in Cq* 1 which had been dependent on the 
State of the eys-tea (the State of the limb is uniquely determined by 
the positions and velocities of all the joints) becomes a constant. We can 


(eq. 2) 


represent our equations of motion as: 

By grouping terms and making the equation explicit in the torque exerted 
by the muscle we can sake one further simplification; 

3) 

where: jf - G + _B + C 

U m ’ JSt be rententer*d that this equation only applies to the motion of 
the limb during one time slice, and only the slice to which apply the 
values of the K 2 + N constants which comprise J and K+ Bothin* prevents 
from applying, eq. 3 to other time slices provided w * can 
find values of J and K appropriate to the state of the system prevailing 
during those slices. We can describe eq. 3 as the piece-wise linearised 
version of eq + 1, and the state for which the constants are chosen as the 
operating point. Although the development so far Indicates that we- 
calculate the torque needed at each Joint of the limb* we will see shortly 
that the value calculated can he the net fort* exerted by the tendon, or 
a special version of the command to the reuscle. 

Supposing we have available the constants required, we could 
Cake the description of an entire moueiMnt, slice it up into enough 
time Interval* so that the change in position and velocity for each 
joint i 5 negligible, a n d determine the Muscular torque needed to produce 
the desired acceleration for each interval. If the appropriate initial 
condition* were satisfied and each torque were applied for the duratfon 
of the interval for which it was computed* the resulting aovement would 
closely resale the originally specified nHva»nt. The reproduced 
movement COuld be made arbitrarily close to the desired movement by 
reducing the duration of the time slices, provided that the constants 


needed were available for each of these new* shorter slices. Tnis 
scheme will only work if the ac cel era t Lone present in the description of 
the desired movement are limited ip. ^Magnitude to those pruduceable by 
the limb 1 e- Muscles. Violation of this restriction *1X1 result in 
specification of a torque vector which is not achievable and the 
resulting, motion* assuming that acme attainable torque is used instead* 
will not conform to the desired response* It should be realized that 
tills problem most be faced by any solution to the translating problem 
ond is not unique to the solution given here. 

Ihe solution given So far is only a partial description of the 
computations performed by the translator since we have not yet indicated 
hov the constants which describe the mechanical nature of the ays tec. 
are found* nor bow they are affected by motor experience and changes 
in the mechanical system.* 

In, I960 von hoist: and Mittlcstadt used the concept of effefence 
Copy in a model which wag designed to account for the ability of a fly 
to distinguish between internally and externally produced changes in 
sensory stimulation (22,24)* Their notion was that the relationship 
between an externally generated signal describing changes in sensory 
Stimulation and an internally generated signal describing impending 
changes in the position of the sensory surface would always give 
unambiguous Information about movement in the external world. This 
internal signal is known as the efferenca copy. In Maid’s model of 1961 
the Holstian view was augmented to allow attainment of perceptual accuracy 
even after changes were made to the meaning of sensory signals (10,11). In 
this model the efference copy waa used to elicit the trace of previews 
ro-af ference and this trace waa compared to the Cutr-ent afferencc ■ Young 
and Stark proposed an elaborate model in 1965 in order to account for the 


ability of a human performing a tracking task to change cnncroL strategies 
when there were changes in the dynamics of the controlled element {28). 

In that tod del the effarance copy was used to drive an internal dynamic 
made! of the controlled element,, and the output of that [nodal was compared 
with the affarante from the control task. 

In the present model the relationships between the fcfference copy 
and the re-a£ferencfi are used to determine the constants which represent 
the mechanical proper ties of the limb and are used by the translating 
mechanism. As will be seen, the use made of the efference copy in Chi® 
model ia aoziewhat unique ip that there is no comparator* no error signal 
is calculated, and no error correction procedure is used. Esther, 
detailed Information about the mechanics of the limb are found by CKamlaing 
the limb’s input’-output relations. Mechanical properties are do rived 
directly from the results of the organism.'s attempts to move. 

h’e return, once more, to the special aquations of motion which 
govern, the system's behavior during one tire slice, with the understanding 

. 2 

that what must he found are the M +■ a constants which comprise J and L 
If we consider the scalar aquation (H = 1): 

t - j - i + k 

it is known that w* can find j and k by simultaneously solving two 
equations in cwo unknowns. He first make mtasulfeMIfttS of the torque 
and acceleration for cwo m^veoenfs and calculate the desired data3 



For the case where IS f 1, (for a limb having a number of Joints) we 




must N + N measurements of torque And acceleration and solve 

+ K equations. By analogy to eq, -4; 


K ”1 L - Ml - ■ (R - S)J 

j - (p - <y * (r - s) -1 


where; P * Hi ! ! ^ 3 ,1 


T 1 

IjfJ 


a - W 


1= L®*] i 2 i £ 3 i • ■ • a*] 
- * [ %*i : \+i- Vl i h b 

and ^ 


T ] 




{eq. 1 ) 


T r and ifl. are the l r th me-usurcmentB of T and 


We see that these calculations can he performed if If + 1 sets of 
sad T. are available where the acceleration vector is the response 
produced by issuing the torque vector as a comr.and, These computations 
derive information about the mechanics of the system from the 

41 

relationships between the efference copy, ^T, and the re-sf f e rente > 

2 

Once again remember, wc need co find the values of the M +■ N constants 
which are appropriate to the state which prevails during a particular 
time Slice* If this is to be so* each measurement contributing to the 
calculation made by eq* 5 must have been made whllfe the system was in or 
near the state of interest. 

The procedure for finding til* values of the mechanical constants 
J and for one time slice are given above, but our goal is to process 
movements which arq composed of many slices n each of which t;ay correspond 
to different mcchunltal states of the Limb. To ensure the achievement 
of this goal the operations of collecting data and calculating constants 
muBt be organised. The necessary organization arises from the consideration 
of a discrete state space and the use of two types of memory; the 
temporary buffer and the scare space memory. 
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3yatCarjclOE1 have 8 cored, nor can ±t calculate the constants 
needfcJ fCr CVery *CCa±n*ble state of the limb, for the number of * ueh 
constants is infinite. The best it can do lg let * ttC h state he 'near 1 
a state for which data are stored or can he stored. L«t us divide the 
range of each dimension of the state space. Coach joint's position and 
velocity) into H intervals. The 2 !N dimensional state apace is then 
partitioned into M t2Nj regions or hyp* rent, es< [f M Is chosen to make the 
Size of each hypercube reasonably small, and the values of J an d K 
are available for one abate in the hypercube, then all the states in 
that hyprreube can he said to be near a state for which data are stored. 

If all the r.easu remen Ls contributing to the calculation of a set of 
Constanta, J and &war* generated while the state of the limb in one 
hypercubc. the assumption can be made that the contents correspond to 
□ State in chat hypufeuhe. This statement will surely be true for largo M 
If one keeps in mind this notion of a discrete state space, the 
operation of the translator with respect to the acquisition of constants 
Of mechanical description can be *ude clear. During self^produced 
movements data are generated which must Subsequently he used to calculate 
tne constants of mechanical description. The data for these computations 
are pairs of simultaneously generated acceleration and torque vector*. 
Ih&se pair* of vectors cannot always be used Immediately because each 
application of e q . 5 requires H 4- I sets of vectors from the same region 
Of state space. Since the state of the li-fc is constantly changing, only 
a limited amount of data fro,. each »v«ne n t is pertinent to a givon 
region of U» state space *t a time, and the data that are available 
m.Lst he saved. Hence the temporary buffer. Although its use Ls quit, 
different, the type of daL* stored in this buffer is similar to that of 


Held's correlation user* £10.11), 

When N + I pairs of vectors from the same region of state space 

accumulate in the temporary buffer* J_ and K. are calculated by the translator, 

and they must be saved. The state space laeisery is organised so that it 
2 

can store N + N cona tents for each hypercube of the discrete state space — 

1 2W 

(N 1 " + K) ■ (M ) constats in all. In ref tain cases values for 

and K Hill be calculated for tcgionE of the space for which previous results 

emist. In order to reduce noise and provide the ability to adapt ta 

changes in the mechanical properties of the system new and old values 

*£ J and K are averaged with some sort of weighting which fdvora recent 

data. 

Figure 4 is a diagree of the system under discuss ion. Operation 
of the Qc>dei cart be Summarised as follows . High level processors 
produce descriptions of desired movements which are presented to the 
translator. These descriptions explicitly state the time course of ehe 
movement so that position, velocity, and acceleration information are 
available for each dimension of the coordinate space in use. The 
desired movement is sectioned into time intervals or slices s each of 
duration it. For each time slice eq, 3 1$ used ifi conjunction with the 
mechanical information in the state space memory, to find the forces which 
will be used in an attempt to produce a movement having the desired 
ftccelerdtlom. The coeewnid forces calculated are issued to the lias? end, 
while the movement is in progress a copy of the command, the efference 
copy, and a copy of the sensory signals which indicate the progress of 
the movement, the re-afferenee, are stored in the temporary buffer with 
labels which indicate the region of the state space to which they apply. 
Subsequently, the contents of the temporary buffer and cq. 5 arc used to 



tig, 4 The raajoT components of the tratis.Lator motfel oCe shcvn 
description of itfc Operation is given in the text. 


A 
















find values of J and K, and these reunite are stored in the state spate 
-emory in combination with data that might have been stored there 
previously. 

It is important to note that the geometry and linearity of the 
sensote and the geometry of thft It nil) place no constraints on the 
translator presented here* This fa a direct result of the piece-wise 
linearization, process to which we have Submitted the mechanical system,. 

I'rom a practical point of view, this means that re-afference can, take 
the form of visual feedback just as readily as Joint oriented proprioceptive 
feedback. It meang that the joints can be revolute or sliding. It also 
mecins that the forces applied by the muscles can undergo non-linear 
transformations -due to the joint-tendon geometry* without consequence. 

Unfortunately, one constraint still exists on the relationship 
between the motor cocsaand and the force exerted by A muscle on its tendon. 
This relationship must he linear in the following sense: 

■ T = a(i.i) ■ E + b<£,i> (oq. 6) 

where: T is the farce produced at the tendOn 

E is the motor command 

and are state dependent eons tents. 

This restriction a ay a that for any given 8-tate of the limb, incremental 
changes in the mo Cot coinamnd mu s t pro dune proportional changes in the 
tendon force o-f the muscle. This is a very weak form of linearity. 

It docs not say that the force in the tendon needs to ha proportional to 
the motor command* not that the force delivered by the muscle must be 
Constant 1? the Command does not change. Indeed., if a human arm is 
moving and the comtaund to the muscle does not change, the force at the 
tendon will increase if the muscle is stretched and decrease if unloaded. 

The only requirement is that, given the game mechanical conditions 
Ci,e H the state does not change) all increases in command produce 
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changes in. force which are related by a constat multiplier. 

Actually, the fact that this relationship must be true for tMi 
iuoJcJ. to work., even If it re-outre.-, the presence of pvQceasInjg to 

ensure it, can be viewed aa a feature from the translator's point of 
vlftw T If this relationship were not guaranteed, Che adaptive nature of 
the translator would respond to changes in the mechanical aystea caused 
by Eus:u.iir fatigue, and that process would reduce the system's immunity 
to noise. 

Behavior of the Ifodel 

Initially, the performance of the translating mechanism will be 
quite poor. Every attempt to uae inforaatJon about the mechanical 
Character of the liisfc will be frustrated because the state space memory 
will he empty* Data about the mechanics of the limb are only available 
after movements have been processed. Iff no data from the state space 
memory are available two things can happen. The translator can use 
50 me preset or genetically encoded constants and proceed to generate 
u set of commands even though the resulting movement may be quite 
different from the one ■desired. Alternately, some other control sy*tm 
could take over when the translator finds thac it has no usable 
information. Under this circumstance the traqilabt would not take 
part in the production of the movement. In either case it i B important 
tb at the remainder -of the t ran* I star’s functions £i.e. the analysis of 
the efference copy and the re-affcfence) be performed when the movement 
is executed, even though the resulting aovea^nt may hear little resemblance 
to that specified by the high level processor* If this were not the case 
the translator would never have the opportunity to build up its memory 
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aiid iffiprtve. (This would be something like the fellow who cannot get 

a Job because he has no experience, and cannot get any experience without 
a job.) 


As more and sore novements of the limb are made, bode and more 
■data describing the mechanics of its operation are available to the 
translator. During this period of data acquisition the quality of movement 
produced by the translator will gradually improve. It should be stressed 
that the reason for this iimprovement is not that errors in previous 


movements arc explicitly corrected, nor that error* in the constants 


which specify tha mechanical properties are explicitly corrected. 

Movement error* can only be detected if a corapariaon between deal red and 
produced movements i* made and this ie never done by the system presented 
here. Motor performance is gradually improved with experience for two 
reaso ns i 

1) Each movement submitted for translation requires data 
from a number of regions in the state apac* memory. More 

of those data ere available when the system is more experienced n 
because these data am generated directly from the movements 
which comprise experience. 

2) If there is any noise in the system (there always is noise 
in physical systems) the data available from the state Space 
=e=ory become more accurately specified when they are 
calculated a number of times because noise is reduced 
through averaging 4 


Though the general level of motor performance is improved with 
experience, the performance of a specific movement can he improved 
through concentrated practice. In this case iDprovement is accelerated 
because a higher percentage of the incoming data are reinvent to the 
regions of cha State space memory which will be used to attempt the 
movement of interest, It la also true that more move&enc data of any 
kind arc available during practice. While Heavy practice of one or a 
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group of movements should improve the ability to make the practiced 
movements, in some cases other movements will also be facilitated. 

This will be true when the Othot movements sre similar to those practiced. 
Ifty similar w*: mean that the same regions of the state spece memory ere 
used to generate the movement. This type of transfer might correspond 
to Thom dyke's "identical elements" theory, although he probably had 
a higher level process in mdnd (13,19). The type of transfer described 
here, from a highly practiced coveaent to a similar, but less practiced 
One disc contributes to the appearance of a general improvement of motor 
performance. In fact, the charectefistic which prompts us to cell the 
improvement general is that entirely new movements are performed with 
only modest amounts of error, though never before explicitly practiced. 

It must be understood that the effectiveness of concemtraceJ practice 
upon the practiced and similar movements is influenced to a large degree 
by the details of the practice strategy — dotatla which are not considered 
here, 

When the constants fox a region of the state space memory are 
calculated a number of times, we C*n expect the cveragn of thoau 
calculations to converge upon the true value of the mechanical properties 
they represent. This will happen when the mechanical pro pert ib-E of the 
limb iire constant but there is noise in the system. In the event 
the mechanical properties arc not constant — a situation which can 
occur when the organism grows, the mueeles get stronger. Of the sensory 
elements change — repeated calcualtions of the mechanical constants 
will reflect the changing properties and ultimately converge some titie 
after t3ie changing limb stabilises. The exact nature of this adaptation 
process wilt depend on the rules of comb thation which apply to the storage 


of new data In the state spat* Euemory. The only statement nn this score 
to be made here is that a weighted average which favors recent data 
will perform in an adaptive way. Improved noise rejection will be 
demonstrated, however t if the time-cons tant of the mecory la aa long as 
possible, whiJe still being ahorc with r«p*ct to the Eims-constant of 
changes In, the mechanical properties of the lizb , 

At this point wo must reiterate that all the properties of the motor 
system are not being attributed to the translating mechanism. Just 
because the translator learns and adapts does not mean that other 
processors do not also learn and adapt. It is assumed that they do. 

Test Inn, the Model 

The model presented her« will be most useful after ft has been 
tested* This ia so for the rteurophysiolofilet who wants to understand 

man and for the engineer who wants to design more advanced autonomous 
Aa chines. 

To many ncurophysicinglets. tea ting 3 model of motor function 
means showing that the biological totot system conforms to predictions 
drawn from the model. There is another kind of tfcSt -- cine which verifies 
cfctat the properties and powers alleged to come with A model are actually 
products of the -operations and computations it perfomE. This second 
type of test should b<i required of a model before its predictions are 
related to the biological organism, for only after such a test does 
confirmation ot predictions about the biological system result in our 
increased understanding. Without verification accurate prediction* only 
mean that the modeller predicted ocurrec tly T not that tile model describes 
the- behavior under study. While iasues regardinfi the biological system 
are of little consequence to the engineer, ti* raust also have a verified 



iwady! if lie la to proceed to problems of technology, cost, practical! ty , 
and usefulness. 

We have begun to conduct testa of an implementation of the model 
presented. The embodiment of the motor system used In those teats 
tons 1 sta of a small computet (EdPU/ 45), soma simple analog circuitry* 
and the HXT-Vicarm manipulator (See Fig. 5). Preliminary result* show 
a rudimentary ability to learn, hut the presentation of conclusive data 
awaits the elimination of some methodological difficulties and the 
completion of a thorough sat of experiments. These experiments are 
designed to show that: 

1) The system can ijse the results of practice to improve 
its performance. 

2 ) Attempts to practice One. movement can favorably influence 
performance of other movements. 

3) The system can adapt to mechanical disturbances caused 

by the application of inertial, constant force, and varisbLe 
force loads. 

4}- The ays tern can adapt to disturbances caused by distortions 
of the sensory signals used in learning. 

5) ‘Hie form of the reafferente signal is not constrained to 
any one coordinate system, 

The results of chebe experiments will ho presented in a forthcomming 
companion to the current Article. 


5 <next page) Tin? layout, of the first three joints of the HIT-Vf carm 
manipulator are shown. 0^ acts about the vertical axis. Hie manipulator 
is about the else of a human am; 1 =.273m, 1-1 -.059m* 1 -203m. 

Each joint is provided with A UC torque motor, a^poteeitioinecOr, a 
LaLjqpmeter* and a clutch-type broke. The diagrnm Is from reference 
14 with modifications. 



Fig. 5 


























App endix A 


The following Is taken from appendix A found In Kahn {15) . Of 
the. 15 pages needed to expand equations A.l, A. 2 , and A, 3 only 3 are 
shewn here to give the reader the flavor of his findings. 


EQUATIONS OF MOTION FOR A GENERAL KINEMATIC CHAIN 
CONTAINING TKRFE REVOLUTE JOINTS 

In this appendix, equations of motion are given for a general 
kinematic chain containing three rcvolutft joints* These equations were 
obtained hy expanding the matrix products in Eq< (2,18) on a digital 
cCrr-Putee using an algebraic manipulation program called REDUCE [46.. In 
tenr-a of the REDUCE notacion, the equation* of motion are 

HU e L +■ MIS ft 2 + M13 + Dili + DL22 + P135 9® 

+ 3112 4 DL13 6-,0^ + D123 & 2 S 3 + CRl = Tj (A.l) 

ms e L + >ea ^ + 1E3 + kii^ + dsss. ^ + 1^33 k* 

+ ceis 6^ + ueij 0 ^ 4 D££3 e 2 0 5 + GR2 - T 2 (a. 2 } 

M13 g L + M23 & 2 4 H 33 + 3311 0^ + D 322 0® 4 D33? 0^ 

4 D3L£ e^g + 3313 + D?S3 9^ + GR3 - (A t J) 

IP other words, HL2 ia the coefficient of in the first equation, 

4a 

P P 

D £13 is the coefficient of 0^9 in Ihc second equation* and GR3 ia 
the gravity term IP the third equation; other term* ate similarly defined. 
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